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(57) Abstract 

A correction circuit (20) processes digitized signals from an image sensor (10) and generates gain correction values to 
compensate for variations in the output of the sensor. While imaging a gain calibrating object (34), the sensor is operated in a cal- 
ibration mode in which a plurality of calibration values are generated that pertain to each photosite. The digitized calibration va- 
lu^retFSnTformed into log space for processing by a gain level averaging circuit (22). The log calibration signals are first sub- 
tracted from a reference corresponding to a maximum expected signal value. The difference signals are serially accumulated by 
means of pair of registers (36, 42) and an adder (38), and the sum is stored in a gain memory (24). In a subsequent normal operat- 
ing mode, the summed signals for each photosite are retrieved from the gain memory (24) and bit-shifted to form an average cor- 
rection value for each photosite. The correction values are applied to an adder (26) in synchronism with sensor signals Irom like 
photosites and added therewith in log space to provide gain compensation. 
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METHQD AND APPARATUS FOR COMPENSATING 

FOR SENSITIVITY VARIATIONS IN THE 
OUTPUT OF A SOLID STATE IMAGE SENSOR 

5 Technica l Field 

This invention relates to signal processing 
of. image signals from an image sensor, and more 
particularly; to a method and apparatus for . 
K generating correction values to account for 
10 variations in the sensitivity- of different 

photbsiteis 6n a solid state; image^serisor ' ; V 
Background Art V' ; '\ : " : ' ; ^ ' 

Variations in photodiode dark current and 
sensitivity as well as light source non-uniformities 
15 can cause noticeable degradation in the quality of 
scanned images from a solid state sensor. These 
variations can be compensated by calibrating the 
system with no illumination upon the sensor to 
determine an average black level, and by calibrating 
20 the system with the sensor under full illumination 
to determine an average maximum (white) value-. It 
is further well known to perform a calibration with 
regard to each sensor photosite, as shown in the 
following two examples. In U.S. Patent No. 
25 4', 602,291, the "dark current" from the imager array 
(i.e., the signal obtained when no light strikes the 
array) is directed via an analog/digital converter 
to an offset memory, which stores the dark current 
charge from each photosite in digital form. The 
30 offset value is subsequently processed with a white 
level value from each photosite (i.e., the signal 
obtained when a uniform illumination strikes the 
imager) and the difference thereof is stored in a 
gain memory for each photosite. In U.S. Patent 
35 4,760,464, a white value for each picture element is 
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obtained by scanning a white substrate a plurality 
of times and storing the data obtained for each 
scan, and constantly replacing a previous white 
value by a present white value when the present 
5 value is greater than the previous level. 

Correction is then effected .using the maximum 
•' va lues . - ■ 

In the calibration mode described in U.S. 
Patent No. 4 ; 343/021/ j the sensor is presented with a v 
10 f i e Id p f uni f o rm br ightnes s . As a particular sensor 

to a multiplier and multiplied by a correction 
coefficient.; A comparator then decides whether the 
real time, processed multiplier signal is greater or 

15 less than a reference signal. A register/ which 
temporarily stores the correction coefficient, is 
then either incremented or decremented and the 
adjusted correction coefficient value is returned to 
its memory location. The next time the image 

20 element is scanned, the coefficient is again drawn 
from memory and applied to both the multiplier and • 
the indexing register, and the aforementioned 
process is repeated. After many further passes, the 
correction coefficient is altered in such a way that 

25 the processed video data approaches the reference 
signal. 

Each of the aforementioned systems have 
certain disadvantages. The first system, disclosed 
in the *291 patent, calculates coefficients from 

30 only one scan. Such data may, however, contain 

errors caused by dust particles or surface flaws on 
the reference object. The second reference, the 
•464 patent, scans a plurality of times but skews 
every adjustment toward the maximum variation 

35 observed, in effect tending to clamp to the largest 
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noise signal. The latter reference, the '021 
patent, achieves a convergence toward a reference 
value but at the expense of a relatively complex 
system involving multipliers and comparators. 
5 Disclosure of Invention 

Unlike the approaches taken by the prior 
art, we have found certain advantages in doing as. 
much of the calibration as possible in a 
' logarithmically-quantized signal space. For one 
> io : : thing/ a: multiplication step becomes -a' simp lei; 
C: *'! : -}>i: : } addition**: -'^ This ' is of more than passing - signif icance 
^ -^^ ; ^yhen ; - ;i tiki's " realized ! that such circuits are desirably / 
implemented in a digital integrated circuit, where 
multipliers are large and, compared to adders, . 
15 consume a large area on the chip^ Moreover, any 
' chip-saving simplification reduces cost and : 
encourages ordinarily complex features like 
element-by-element correction. 

As a result, a correction circuit 
20 implemented according to the invention provides 
compensation for illumination and sensitivity 
variations appearing in image values on an 
element-by-element basis. That is, a plurality of 
sample values are generated from each photosite 
25 while the image sensor images an object of uniform 
transmittance (or reflectance) • The calibration 
values are then converted to logarithmic calibration 
signals. A logarithmic correction value is 
generated for each photosite from the plurality of 
30 logarithmically-quantized calibration signals 

corresponding to each photosite* The correction 
.values are Jthen stored and, when the image sensor is 
scanning a normal object, the resultant image values 
are altered by applying the stored correction values 
35 to the scanned image values. Each correction value 



aforementioned variations due to imager sensitivity- 
variations and/or light source non-uniformity. The 
light values are digitized by an analog-to-digital 
converter 14 and applied to a, black level correction 
circuit 16. The circuit 16 includes a conventional 
black reference generator and a conventional black 
reference clamp, which are used to establish a 
stable sensor black reference value for the entire 
image . The black reference is an average 5 1 Her ma 1 
d a r k cur rent ; no i s e correct i on p f f set value for the 
• sensor ; ^ wh i ch , uril e ss-C r emb v^d; '-;£ r bm 't he signals , will 
corrupt all subsequent adjustments and corrections. 
The black reference circuit 16 is initially enabled 
by the timing and control logic section 12 to 
collect a sample of dark current signal values and 
to calculate the. average black reference therefrom. 
As the light values are subsequently processed, the 
average black reference value is subtracted from 
each light value in the circuit 16. 

The output of the black level correction 
circuit 16 is transformed into a logarithmically 
quantized space by a linear-to-log ROM look up table 
18. The logarithmic signals are then applied to a 
gain correction circuit 20. Gain correction 
operates in two modes: a calibration mode and a 
normal mode. The image sensor 10 is accordingly 
driven to provide either a sequence of calibration 
values (during the calibration mode) while the 
photosites are subject to uniform illumination or a 
sequence of image values (during the normal mode) 
while the photosites are subject to object 
illumination. The g|ain control circuit 20 is 
operated by a "mode select" signal from the timing 
and control logic section 12 to accordingly process 
the pixel values. The gain correction values for 
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the photosites are first computed in a gain level 
averaging circuit 22 and stored in a gain correction 
memory 24 in the calibration mode. In the normal 
mode, the gain correction values are read from the 
5 gain correction memory 24 and added to the image 

value in a correction adder 26. The corrected image 
values are processed by the clipping circuit 28 and 
latched into the output register 30. Since the 
addition by the adder 26. is being performed in log 
-10 space, the image values are being scaled! -in -/a";..'- 

' During the calibration mode , the 'average of - 
the ratio of the maximum expected signal value to 
the sensor output under full illumination is* 
15 calculated- The correction values are computed in 
the gain correction circuit 20 by averaging a 
plurality of values from each photosite on the 
sensor 10 with the sensor illuminated by a light 
source 32 through a defocused "Dmin" filter 34, that 
20 is, a filter having a density corresponding to the 
minimum density of a nominal transparency material, 
which serves as a gain calibration object. 
(Alternatively, the gain calibration object could be 
a clear "open gate" opening to the illumination 
25 source, or could be a uniform substrate when 

scanning reflection materials.) More particularly, 
256 values from each photosite are averaged. The 
averaging is completed in two stages. First, each 
logarithmic signal from the log look-up table 18 is 
30 applied to a subtractor 32 to obtain the log 

difference (iiel, the ratio in linear space) with a 
log reference value provided by a multiplexer 34. 
The subtracted value, which is latched into a 
difference register 36, represents the difference 
35 between the -desired" log space gain calibration 
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signal level and the actual log space gain 
calibration signal level or, in linear space, the 
ratio of these two quantities. In the second stage 
of the averaging process, the difference value in 
5 the difference register 36 is applied to the adder 
38 which sums the difference value with a "running 
sum" value from a correction register 40. The 
summed result is latched into a sum register 42. 
". : ' . The reference vailue is selected by the 

10 multiplexer 34 from either a reference decimal value 
V of 1023 or a programmable value ^GAINREFr supplied 

by an external processor (hot shown) . The ordinary, 
and default, reference value is 1023 (which relates 
to a 10 bit input to the subtracter 32 from the look 

15 up table 18). By choosing the reference value to be 
1023, the value stored in the difference register 36 
will always be positive, so the subsequent "running 
average" value will always be a positive value. 
With the present embodiment, if the programmable 

20 reference "GAINREF" is selected, the user must 

ensure that the signal levels from the sensor do not 
exceed the reference value, since the gain averaging 
circuit 22 is specifically designed to add only 
positive gain reference values. (It should be 

25 understood, however, that the circuit could be 

modified in known ways to handle negative values as 
well as positive values. Likewise, the reference 
value relates ^directly to the bit capacity of the 
circuit, and will be different for different bit 

30 length inputs. ) r . .... 

The gain correction memory 24 interfaces 
with the correction register 40 and the sum register 
42, writing into the correction register 40 and 
reading from the sum register 42. The memory 24 

35 needs to be addressed by the logic section 12 so 



WO 91/18470 



PCI7US91/03181 



-8- 

that the proper "running sum" correction value is 
loaded into the correction register 40 at the proper 
time, and the resulting "sum" value from the sum 
register 40 is written back into the same memory 
5 location in the gain correction memory 24. In this 
manner the new sum value overwrites the previous 
"running sum" value for.'. the particular photosite. 
Once the correction values for each sensor photosite 
from 256 calibration-mode repeti tipns have been 

10 summed/ the output of the correction register 40 

will equal . the proper gain correction sums ; and the 
. gain calibration mode is .complete. 

In the normal mode of operation, the; gain 
calibration object 34 is removed from the light path 

15 and the normal object to be scanned is inserted into 
the light path. The gain corrections stored in the 
gain correction memory 24 for each photosite in the 
image sensor 10 are accessed as each corresponding 
image value is applied to the correction adder 26. 

20 Accordingly, a unique gain correction for each 
photosite is used to alter (by adding to, or, in 
linear space, multiplying with) the image value 
developed for that photosite. In the preferred 
practice of the invention, the gain adder 38 

25 combines a 10 bit difference vailue from 1 the 

difference register 36 with a 16 bit "running sum" 
value from the correction register 40, providing a 
16 bit sum to the sum register 42. Consequently, 
the 8 most significant bits (MSBs) of the "running 

30 sum" values represents, after 256 adds, the proper 
gain correction value, that is, the average of 256 
adds. In the normal mode of operation, only the 8 
MSBs need to be applied from the memory 24. The 
averaging is obtained by the bit shift circuitry 44, 

35 which represents the appropriate hard-wiring between 
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the correction register 40 and the adder 26 to 
accomplish an 8 bit shift. 

In the preferred embodiment, the correction 
signals are limited to a maximum value of 1/4 of the 
5 full range density signal, which corresponds to 0.75 
density units. This is because an 8 bit correction 
value is combined with a 10 bit image value in the 
correction ad^er 26 r and correction values greater 
than 1/4 of the full; range image value will overflow 
; 10 the gain Averaging circuit 22 . > Moreover, the lbg 

calibration values input during the calibration' mode 
must not differ from, the value . provided by the 
multiplexer 34 by more than 256 code values. 
Obviously, these limitations are not aspects of the 
15 invention, but of the particular circuit used to 
implement the invention. 
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What is Claimed is: 

1. A correction circuit for generating 
correction values to compensate for variations 
appearing in image values derived from an image 

5 sensor (10) having a plurality of discrete 

photosites, said sensor operable in a calibration 
mode to produce a plurality of cal ibrat ion values 
f rom j e a ch pho tos i te while the sensor, images a gain 
calibration object (34 ), said circuit comprising:; 
10 means' (18) for converting the 

calibration values to logarithmic calibration 
signals ; 

means (22) for generating a logarithmic 
correction value for each photosite from the .* 
15 plurality of logarithmic calibration signals 
corresponding to each photosite; 

means (24) for storing said logarithmic 
correction values; and 

means (40, 44) for applying said stored 
20 correction values to the alteration "of the image 

values whereby each correction value pertains to the 
photosite producing the image value* 

2. A circuit as claimed in Claim 1 wherein 
said correction value generating means (22) bases 

25 the correction value upon an average of the 
plurality of logarithmic calibration signals 
corresponding to each photosite. 

3. A circuit as claimed in Claim 1 wherein 
said correction value generating means (22) includes 

30 means (32) for subtracting each log calibration 
signal from a reference value corresponding to a 
maximum expected signal value and means (38) for 
generating said log correction value from the 
resultant signals • 

35 4. A circuit as claimed in Claim 1 wherein 
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said image sensor (10) is operable in a normal mode 
to produce image values from the photosites while 
the sensor is subject to object i 1 luminat ion , said 
circuit including means (18) for converting the 
5 calibration values and the image values to 

logarithmic calibration signals and logarithmic 
■image signals, respectively , means (26) operable in 
log space for altering the image values; and wherein 
said- means (40, 44) applies said stored correction 
10 values to said altering means whereby each 

correction value pertains to the photosite producing 
the image value. 

5. A circuit as claimed in Claim 4 wherein 
said correction value generating means (22) bases 

15 the correction value upon an average of the 
plurality of logarithmic calibration signals 
corresponding to each photosite, generating 
therefrom an average correction value, 

6. A circuit as claimed in Claim 5 wherein 
20 said altering means (26) adds the average correction 

value to each image value. 

7. A circuit as claimed in Claim 4 wherein 
said correction value generating means (22) includes 
means (32) for subtracting each log calibration 

25 signal from a reference value corresponding to a 
maximum expected signal value and means for 
generating said log correction value from the 
resultant signals. 

8. A method of compensating for variations 
30 in the output of an image sensor (10), comprising 

the steps of: 

imaging a gain calibration object (34) 
upon the image sensor (10); 

generating a plurality of calibration 
35 values pertaining to each photosite on the image 
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